Update dependency tablemark to v3.1.0 #439

renovate · 2024-04-08T12:20:18Z

This PR contains the following updates:

Package	Change	Age	Adoption	Passing	Confidence
tablemark	`3.0.0` -> `3.1.0`

Release Notes

haltcase/tablemark (tablemark)

`v3.1.0`

Compare Source

FEATURES

support eliding padding in header separator (#17) (a4d24ce), closes #16

Configuration

📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).

🚦 Automerge: Enabled.

♻ Rebasing: Whenever PR is behind base branch, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about this update again.

If you want to rebase/retry this PR, check this box

This PR was generated by Mend Renovate. View the repository job log.

github-actions · 2024-10-02T13:12:21Z

Overview for: `federation-v1/constant-vus-over-time`

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Gateway	RPS ⬇️	Requests	Duration	Notes
cosmo	194	5933 total, 0 failed	avg: 337ms, p95: 789ms	✅
apollo-router	175	5327 total, 0 failed	avg: 482ms, p95: 728ms	✅
wundergraph	150	4588 total, 0 failed	avg: 549ms, p95: 1011ms	✅
mesh-supergraph-bun	78	2412 total, 0 failed	avg: 1227ms, p95: 2160ms	✅
apollo-server	53	1682 total, 0 failed	avg: 1816ms, p95: 2110ms	✅
mercurius	29	906 total, 0 failed	avg: 3353ms, p95: 4779ms	✅
mesh-supergraph	25	825 total, 0 failed	avg: 3737ms, p95: 6126ms	✅

Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 17799      ✗ 0    
     data_received..................: 521 MB  17 MB/s
     data_sent......................: 7.0 MB  231 kB/s
     http_req_blocked...............: avg=247.63µs min=1.41µs  med=2.7µs    max=555.51ms p(90)=4µs      p(95)=4.97µs  
     http_req_connecting............: avg=100.14µs min=0s      med=0s       max=215.6ms  p(90)=0s       p(95)=0s      
     http_req_duration..............: avg=336.76ms min=9.77ms  med=290.21ms max=2.25s    p(90)=604.42ms p(95)=788.95ms
       { expected_response:true }...: avg=336.76ms min=9.77ms  med=290.21ms max=2.25s    p(90)=604.42ms p(95)=788.95ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 5933 
     http_req_receiving.............: avg=82.68ms  min=39.37µs med=78.06µs  max=2.02s    p(90)=321.97ms p(95)=543.62ms
     http_req_sending...............: avg=4.94ms   min=7.46µs  med=13.09µs  max=924.05ms p(90)=98.54µs  p(95)=8.69ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=249.13ms min=9.26ms  med=236.78ms max=771.03ms p(90)=428.11ms p(95)=493.62ms
     http_reqs......................: 5933    194.975197/s
     iteration_duration.............: avg=509.64ms min=19.78ms med=435.42ms max=2.56s    p(90)=968.84ms p(95)=1.21s   
     iterations.....................: 5933    194.975197/s
     vus............................: 100     min=100      max=100
     vus_max........................: 100     min=100      max=100

Performance Overview

Subgraphs Overview

HTTP Overview

Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 15981      ✗ 0    
     data_received..................: 467 MB  15 MB/s
     data_sent......................: 6.3 MB  208 kB/s
     http_req_blocked...............: avg=36.23µs  min=1.4µs   med=2.78µs   max=81.17ms  p(90)=4.34µs   p(95)=5.54µs  
     http_req_connecting............: avg=14.22µs  min=0s      med=0s       max=2.88ms   p(90)=0s       p(95)=0s      
     http_req_duration..............: avg=481.74ms min=28.48ms med=479.61ms max=1.96s    p(90)=624.31ms p(95)=727.61ms
       { expected_response:true }...: avg=481.74ms min=28.48ms med=479.61ms max=1.96s    p(90)=624.31ms p(95)=727.61ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 5327 
     http_req_receiving.............: avg=37.15ms  min=36.01µs med=74.83µs  max=1.77s    p(90)=82.64ms  p(95)=201.03ms
     http_req_sending...............: avg=2.53ms   min=8.03µs  med=13.51µs  max=1.16s    p(90)=43.45µs  p(95)=227.54µs
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=442.06ms min=17.99ms med=464.1ms  max=927.39ms p(90)=578.51ms p(95)=609.64ms
     http_reqs......................: 5327    175.505151/s
     iteration_duration.............: avg=566.56ms min=41.5ms  med=527.1ms  max=2.81s    p(90)=767.13ms p(95)=962.6ms 
     iterations.....................: 5327    175.505151/s
     vus............................: 100     min=100      max=100
     vus_max........................: 100     min=100      max=100

Performance Overview

Subgraphs Overview

HTTP Overview

Summary for: `wundergraph`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 13764      ✗ 0    
     data_received..................: 403 MB  13 MB/s
     data_sent......................: 5.4 MB  179 kB/s
     http_req_blocked...............: avg=30.27µs  min=1.38µs  med=3.03µs   max=24.54ms p(90)=4.69µs   p(95)=6.41µs  
     http_req_connecting............: avg=12.42µs  min=0s      med=0s       max=2ms     p(90)=0s       p(95)=0s      
     http_req_duration..............: avg=549.06ms min=23.29ms med=512.36ms max=1.94s   p(90)=891.09ms p(95)=1.01s   
       { expected_response:true }...: avg=549.06ms min=23.29ms med=512.36ms max=1.94s   p(90)=891.09ms p(95)=1.01s   
     http_req_failed................: 0.00%   ✓ 0          ✗ 4588 
     http_req_receiving.............: avg=44.96ms  min=39.68µs med=86.68µs  max=1.71s   p(90)=122.94ms p(95)=336.47ms
     http_req_sending...............: avg=3.14ms   min=7.76µs  med=13.87µs  max=867.3ms p(90)=45.94µs  p(95)=492.1µs 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s      p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=500.95ms min=20.8ms  med=469.78ms max=1.59s   p(90)=823.15ms p(95)=919.06ms
     http_reqs......................: 4588    150.835347/s
     iteration_duration.............: avg=659.89ms min=34.48ms med=602.06ms max=2.55s   p(90)=1.08s    p(95)=1.21s   
     iterations.....................: 4588    150.835347/s
     vus............................: 100     min=100      max=100
     vus_max........................: 100     min=100      max=100

Performance Overview

Subgraphs Overview

HTTP Overview

Summary for: `mesh-supergraph-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 7236      ✗ 0    
     data_received..................: 212 MB  6.9 MB/s
     data_sent......................: 2.9 MB  93 kB/s
     http_req_blocked...............: avg=166.57µs min=1.43µs   med=3.13µs  max=44.15ms  p(90)=5.13µs  p(95)=11.96µs 
     http_req_connecting............: avg=142.01µs min=0s       med=0s      max=9.55ms   p(90)=0s      p(95)=0s      
     http_req_duration..............: avg=1.22s    min=558.35ms med=1.05s   max=3.18s    p(90)=1.95s   p(95)=2.15s   
       { expected_response:true }...: avg=1.22s    min=558.35ms med=1.05s   max=3.18s    p(90)=1.95s   p(95)=2.15s   
     http_req_failed................: 0.00%   ✓ 0         ✗ 2412 
     http_req_receiving.............: avg=15.05ms  min=40.98µs  med=113.9µs max=588.85ms p(90)=3.03ms  p(95)=78.71ms 
     http_req_sending...............: avg=683.46µs min=8.63µs   med=14.71µs max=185.49ms p(90)=41.61µs p(95)=487.34µs
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s      max=0s       p(90)=0s      p(95)=0s      
     http_req_waiting...............: avg=1.21s    min=558.29ms med=1.05s   max=3.18s    p(90)=1.92s   p(95)=2.15s   
     http_reqs......................: 2412    78.536682/s
     iteration_duration.............: avg=1.26s    min=569.09ms med=1.08s   max=3.21s    p(90)=1.97s   p(95)=2.22s   
     iterations.....................: 2412    78.536682/s
     vus............................: 100     min=100     max=100
     vus_max........................: 100     min=100     max=100

Performance Overview

Subgraphs Overview

HTTP Overview

Summary for: `apollo-server`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 5046      ✗ 0    
     data_received..................: 148 MB  4.7 MB/s
     data_sent......................: 2.0 MB  64 kB/s
     http_req_blocked...............: avg=63.89µs  min=1.54µs   med=3.13µs   max=2.93ms  p(90)=5.22µs   p(95)=192.61µs
     http_req_connecting............: avg=49.51µs  min=0s       med=0s       max=2.75ms  p(90)=0s       p(95)=148.01µs
     http_req_duration..............: avg=1.81s    min=848.24ms med=1.55s    max=18.75s  p(90)=1.77s    p(95)=2.11s   
       { expected_response:true }...: avg=1.81s    min=848.24ms med=1.55s    max=18.75s  p(90)=1.77s    p(95)=2.11s   
     http_req_failed................: 0.00%   ✓ 0         ✗ 1682 
     http_req_receiving.............: avg=209.89µs min=47.22µs  med=121.13µs max=18.01ms p(90)=204.67µs p(95)=326.47µs
     http_req_sending...............: avg=58.72µs  min=8.75µs   med=15.9µs   max=10.78ms p(90)=35.31µs  p(95)=162.95µs
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s      p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=1.81s    min=848.06ms med=1.55s    max=18.75s  p(90)=1.77s    p(95)=2.11s   
     http_reqs......................: 1682    53.841553/s
     iteration_duration.............: avg=1.82s    min=888.87ms med=1.56s    max=18.78s  p(90)=1.79s    p(95)=2.12s   
     iterations.....................: 1682    53.841553/s
     vus............................: 38      min=38      max=100
     vus_max........................: 100     min=100     max=100

Performance Overview

Subgraphs Overview

HTTP Overview

Summary for: `mercurius`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 2718      ✗ 0    
     data_received..................: 80 MB   2.6 MB/s
     data_sent......................: 1.1 MB  35 kB/s
     http_req_blocked...............: avg=118.98µs min=1.48µs   med=4.21µs   max=5.61ms p(90)=154.19µs p(95)=797.81µs
     http_req_connecting............: avg=100.07µs min=0s       med=0s       max=3.9ms  p(90)=101.36µs p(95)=669.55µs
     http_req_duration..............: avg=3.35s    min=559.47ms med=3.16s    max=8.09s  p(90)=4.18s    p(95)=4.77s   
       { expected_response:true }...: avg=3.35s    min=559.47ms med=3.16s    max=8.09s  p(90)=4.18s    p(95)=4.77s   
     http_req_failed................: 0.00%   ✓ 0         ✗ 906  
     http_req_receiving.............: avg=267.93µs min=45.87µs  med=113.05µs max=72.1ms p(90)=203.08µs p(95)=309.55µs
     http_req_sending...............: avg=102.61µs min=9.12µs   med=22.92µs  max=2.23ms p(90)=66.84µs  p(95)=389.55µs
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s     p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=3.35s    min=559.22ms med=3.16s    max=8.09s  p(90)=4.18s    p(95)=4.77s   
     http_reqs......................: 906     29.435115/s
     iteration_duration.............: avg=3.36s    min=572.06ms med=3.17s    max=8.1s   p(90)=4.19s    p(95)=4.78s   
     iterations.....................: 906     29.435115/s
     vus............................: 100     min=100     max=100
     vus_max........................: 100     min=100     max=100

Performance Overview

Subgraphs Overview

HTTP Overview

Summary for: `mesh-supergraph`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 2475      ✗ 0    
     data_received..................: 72 MB   2.3 MB/s
     data_sent......................: 979 kB  31 kB/s
     http_req_blocked...............: avg=195.49µs min=1.41µs  med=3.65µs  max=5ms     p(90)=208.07µs p(95)=1.87ms  
     http_req_connecting............: avg=182.75µs min=0s      med=0s      max=4.97ms  p(90)=156.64µs p(95)=1.7ms   
     http_req_duration..............: avg=3.73s    min=1.27s   med=3.59s   max=8.74s   p(90)=5.4s     p(95)=6.12s   
       { expected_response:true }...: avg=3.73s    min=1.27s   med=3.59s   max=8.74s   p(90)=5.4s     p(95)=6.12s   
     http_req_failed................: 0.00%   ✓ 0         ✗ 825  
     http_req_receiving.............: avg=2.55ms   min=38.67µs med=143.2µs max=76.12ms p(90)=2.51ms   p(95)=5.07ms  
     http_req_sending...............: avg=88.94µs  min=8.52µs  med=20.56µs max=1.28ms  p(90)=112.73µs p(95)=821.65µs
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s      p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=3.73s    min=1.26s   med=3.59s   max=8.74s   p(90)=5.39s    p(95)=6.12s   
     http_reqs......................: 825     25.771146/s
     iteration_duration.............: avg=3.75s    min=1.29s   med=3.61s   max=8.75s   p(90)=5.42s    p(95)=6.15s   
     iterations.....................: 825     25.771146/s
     vus............................: 5       min=5       max=100
     vus_max........................: 100     min=100     max=100

Performance Overview

Subgraphs Overview

HTTP Overview

github-actions · 2024-10-02T13:12:27Z

Overview for: `federation-v1/constant-vus-subgraphs-delay-resources`

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Gateway	RPS ⬇️	Requests	Duration	Notes
cosmo	182	5545 total, 0 failed	avg: 292ms, p95: 873ms	✅
apollo-router	171	5195 total, 0 failed	avg: 337ms, p95: 902ms	✅
wundergraph	155	4705 total, 0 failed	avg: 347ms, p95: 938ms	✅
mesh-supergraph-bun	85	2661 total, 0 failed	avg: 1114ms, p95: 1888ms	✅
apollo-server	73	2272 total, 0 failed	avg: 1333ms, p95: 1529ms	✅
mesh-supergraph	53	1671 total, 0 failed	avg: 1814ms, p95: 2671ms	✅
mercurius	47	1445 total, 0 failed	avg: 2088ms, p95: 2788ms	✅

Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 16635      ✗ 0    
     data_received..................: 487 MB  16 MB/s
     data_sent......................: 6.6 MB  217 kB/s
     http_req_blocked...............: avg=43.16µs  min=1.51µs  med=3.03µs   max=14.12ms  p(90)=4.45µs   p(95)=5.86µs  
     http_req_connecting............: avg=33.4µs   min=0s      med=0s       max=13.31ms  p(90)=0s       p(95)=0s      
     http_req_duration..............: avg=292.35ms min=9.02ms  med=202.71ms max=2.3s     p(90)=709.12ms p(95)=873.47ms
       { expected_response:true }...: avg=292.35ms min=9.02ms  med=202.71ms max=2.3s     p(90)=709.12ms p(95)=873.47ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 5545 
     http_req_receiving.............: avg=132.6ms  min=33.75µs med=100.8µs  max=1.97s    p(90)=525.05ms p(95)=709.05ms
     http_req_sending...............: avg=6.62ms   min=8.48µs  med=14.16µs  max=1.4s     p(90)=78.44µs  p(95)=3.26ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=153.12ms min=7.51ms  med=140.26ms max=733.23ms p(90)=283.43ms p(95)=319.48ms
     http_reqs......................: 5545    182.886586/s
     iteration_duration.............: avg=544.3ms  min=20.95ms med=397.42ms max=3.34s    p(90)=1.18s    p(95)=1.48s   
     iterations.....................: 5545    182.886586/s
     vus............................: 100     min=100      max=100
     vus_max........................: 100     min=100      max=100

Performance Overview

Subgraphs Overview

HTTP Overview

Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 15585      ✗ 0    
     data_received..................: 456 MB  15 MB/s
     data_sent......................: 6.2 MB  203 kB/s
     http_req_blocked...............: avg=28.78µs  min=1.67µs  med=2.99µs   max=11.05ms  p(90)=4.59µs   p(95)=5.94µs  
     http_req_connecting............: avg=20.54µs  min=0s      med=0s       max=2.87ms   p(90)=0s       p(95)=0s      
     http_req_duration..............: avg=337.29ms min=9.87ms  med=245.68ms max=1.8s     p(90)=733.94ms p(95)=901.53ms
       { expected_response:true }...: avg=337.29ms min=9.87ms  med=245.68ms max=1.8s     p(90)=733.94ms p(95)=901.53ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 5195 
     http_req_receiving.............: avg=134.72ms min=35.39µs med=85.87µs  max=1.6s     p(90)=509.75ms p(95)=675.31ms
     http_req_sending...............: avg=7.61ms   min=8.68µs  med=14.09µs  max=1.21s    p(90)=56.5µs   p(95)=2.39ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=194.95ms min=9.79ms  med=184.79ms max=883.62ms p(90)=329.98ms p(95)=393.28ms
     http_reqs......................: 5195    171.138577/s
     iteration_duration.............: avg=580.59ms min=30.61ms med=458.26ms max=3.33s    p(90)=1.2s     p(95)=1.47s   
     iterations.....................: 5195    171.138577/s
     vus............................: 100     min=100      max=100
     vus_max........................: 100     min=100      max=100

Performance Overview

Subgraphs Overview

HTTP Overview

Summary for: `wundergraph`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 14115      ✗ 0    
     data_received..................: 413 MB  14 MB/s
     data_sent......................: 5.6 MB  184 kB/s
     http_req_blocked...............: avg=191.26µs min=1.49µs  med=3.09µs   max=249.94ms p(90)=4.48µs   p(95)=8.02µs  
     http_req_connecting............: avg=125.95µs min=0s      med=0s       max=212.16ms p(90)=0s       p(95)=0s      
     http_req_duration..............: avg=347.05ms min=13.75ms med=268.77ms max=3.68s    p(90)=745.25ms p(95)=938.32ms
       { expected_response:true }...: avg=347.05ms min=13.75ms med=268.77ms max=3.68s    p(90)=745.25ms p(95)=938.32ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 4705 
     http_req_receiving.............: avg=134.08ms min=38.46µs med=104.63µs max=2.62s    p(90)=531.6ms  p(95)=719.38ms
     http_req_sending...............: avg=6.2ms    min=9.15µs  med=14.19µs  max=2.63s    p(90)=119.64µs p(95)=2.05ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=206.75ms min=10.18ms med=195.62ms max=684.27ms p(90)=347.99ms p(95)=410.54ms
     http_reqs......................: 4705    155.139402/s
     iteration_duration.............: avg=641.06ms min=27.14ms med=517.87ms max=3.7s     p(90)=1.31s    p(95)=1.57s   
     iterations.....................: 4705    155.139402/s
     vus............................: 100     min=100      max=100
     vus_max........................: 100     min=100      max=100

Performance Overview

Subgraphs Overview

HTTP Overview

Summary for: `mesh-supergraph-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 7983      ✗ 0    
     data_received..................: 233 MB  7.5 MB/s
     data_sent......................: 3.2 MB  102 kB/s
     http_req_blocked...............: avg=29.44µs min=1.61µs   med=2.85µs   max=3.96ms   p(90)=4.59µs  p(95)=9.92µs 
     http_req_connecting............: avg=22.27µs min=0s       med=0s       max=3.92ms   p(90)=0s      p(95)=0s     
     http_req_duration..............: avg=1.11s   min=278.53ms med=964.99ms max=2.34s    p(90)=1.74s   p(95)=1.88s  
       { expected_response:true }...: avg=1.11s   min=278.53ms med=964.99ms max=2.34s    p(90)=1.74s   p(95)=1.88s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 2661 
     http_req_receiving.............: avg=13.15ms min=37.35µs  med=94.58µs  max=518.23ms p(90)=6.5ms   p(95)=99.31ms
     http_req_sending...............: avg=530.1µs min=8.87µs   med=13.72µs  max=166.36ms p(90)=43.74µs p(95)=148.5µs
     http_req_tls_handshaking.......: avg=0s      min=0s       med=0s       max=0s       p(90)=0s      p(95)=0s     
     http_req_waiting...............: avg=1.1s    min=278.03ms med=956.52ms max=2.34s    p(90)=1.72s   p(95)=1.87s  
     http_reqs......................: 2661    85.850837/s
     iteration_duration.............: avg=1.15s   min=291.76ms med=1s       max=2.46s    p(90)=1.78s   p(95)=1.92s  
     iterations.....................: 2661    85.850837/s
     vus............................: 1       min=1       max=100
     vus_max........................: 100     min=100     max=100

Performance Overview

Subgraphs Overview

HTTP Overview

Summary for: `apollo-server`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 6816      ✗ 0    
     data_received..................: 200 MB  6.4 MB/s
     data_sent......................: 2.7 MB  87 kB/s
     http_req_blocked...............: avg=143.44µs min=1.42µs   med=2.75µs   max=7.09ms  p(90)=4.58µs   p(95)=15.51µs
     http_req_connecting............: avg=135.07µs min=0s       med=0s       max=7.06ms  p(90)=0s       p(95)=0s     
     http_req_duration..............: avg=1.33s    min=489.82ms med=1.23s    max=13.91s  p(90)=1.36s    p(95)=1.52s  
       { expected_response:true }...: avg=1.33s    min=489.82ms med=1.23s    max=13.91s  p(90)=1.36s    p(95)=1.52s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 2272 
     http_req_receiving.............: avg=170.09µs min=43.58µs  med=111.55µs max=13.27ms p(90)=184.65µs p(95)=267.8µs
     http_req_sending...............: avg=47.81µs  min=8.39µs   med=13.99µs  max=10.82ms p(90)=30.25µs  p(95)=64.46µs
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s      p(90)=0s       p(95)=0s     
     http_req_waiting...............: avg=1.33s    min=489.68ms med=1.23s    max=13.91s  p(90)=1.36s    p(95)=1.52s  
     http_reqs......................: 2272    73.320801/s
     iteration_duration.............: avg=1.34s    min=499.09ms med=1.24s    max=13.92s  p(90)=1.37s    p(95)=1.54s  
     iterations.....................: 2272    73.320801/s
     vus............................: 100     min=100     max=100
     vus_max........................: 100     min=100     max=100

Performance Overview

Subgraphs Overview

HTTP Overview

Summary for: `mesh-supergraph`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 5013      ✗ 0    
     data_received..................: 147 MB  4.7 MB/s
     data_sent......................: 2.0 MB  64 kB/s
     http_req_blocked...............: avg=51.34µs  min=1.52µs   med=4.31µs   max=7.02ms   p(90)=6.49µs  p(95)=148.27µs
     http_req_connecting............: avg=39.58µs  min=0s       med=0s       max=5.47ms   p(90)=0s      p(95)=104.02µs
     http_req_duration..............: avg=1.81s    min=777.99ms med=1.76s    max=4.09s    p(90)=2.43s   p(95)=2.67s   
       { expected_response:true }...: avg=1.81s    min=777.99ms med=1.76s    max=4.09s    p(90)=2.43s   p(95)=2.67s   
     http_req_failed................: 0.00%   ✓ 0         ✗ 1671 
     http_req_receiving.............: avg=1.89ms   min=43.17µs  med=135.78µs max=149.56ms p(90)=2.72ms  p(95)=5.86ms  
     http_req_sending...............: avg=151.14µs min=9.01µs   med=22.96µs  max=34.62ms  p(90)=48.82µs p(95)=165.12µs
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s      p(95)=0s      
     http_req_waiting...............: avg=1.81s    min=764.73ms med=1.76s    max=4.09s    p(90)=2.43s   p(95)=2.67s   
     http_reqs......................: 1671    53.670969/s
     iteration_duration.............: avg=1.84s    min=803.54ms med=1.79s    max=4.13s    p(90)=2.46s   p(95)=2.69s   
     iterations.....................: 1671    53.670969/s
     vus............................: 34      min=34      max=100
     vus_max........................: 100     min=100     max=100

Performance Overview

Subgraphs Overview

HTTP Overview

Summary for: `mercurius`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 4335      ✗ 0    
     data_received..................: 127 MB  4.1 MB/s
     data_sent......................: 1.7 MB  56 kB/s
     http_req_blocked...............: avg=49.92µs  min=1.58µs   med=4.08µs   max=4.42ms  p(90)=6.03µs   p(95)=258.24µs
     http_req_connecting............: avg=33.24µs  min=0s       med=0s       max=2.82ms  p(90)=0s       p(95)=181.51µs
     http_req_duration..............: avg=2.08s    min=350.36ms med=2.05s    max=4.99s   p(90)=2.62s    p(95)=2.78s   
       { expected_response:true }...: avg=2.08s    min=350.36ms med=2.05s    max=4.99s   p(90)=2.62s    p(95)=2.78s   
     http_req_failed................: 0.00%   ✓ 0         ✗ 1445 
     http_req_receiving.............: avg=254.58µs min=47.12µs  med=115.08µs max=37.64ms p(90)=206.11µs p(95)=319.31µs
     http_req_sending...............: avg=46.19µs  min=9.26µs   med=22µs     max=4.09ms  p(90)=39.21µs  p(95)=126.07µs
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s      p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=2.08s    min=350.1ms  med=2.05s    max=4.99s   p(90)=2.62s    p(95)=2.78s   
     http_reqs......................: 1445    47.178758/s
     iteration_duration.............: avg=2.09s    min=362.1ms  med=2.06s    max=5.03s   p(90)=2.63s    p(95)=2.8s    
     iterations.....................: 1445    47.178758/s
     vus............................: 100     min=100     max=100
     vus_max........................: 100     min=100     max=100

Performance Overview

Subgraphs Overview

HTTP Overview

github-actions · 2024-10-02T13:12:31Z

Overview for: `federation-v1/constant-vus-subgraphs-delay`

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Gateway	RPS ⬇️	Requests	Duration	Notes
cosmo	191	5809 total, 0 failed	avg: 337ms, p95: 709ms	✅
apollo-router	171	5230 total, 0 failed	avg: 489ms, p95: 731ms	✅
wundergraph	153	4682 total, 0 failed	avg: 533ms, p95: 1021ms	✅
mesh-supergraph-bun	67	2076 total, 0 failed	avg: 1443ms, p95: 2509ms	✅
apollo-server	54	1703 total, 0 failed	avg: 1791ms, p95: 2329ms	✅
mercurius	29	933 total, 0 failed	avg: 3298ms, p95: 4280ms	✅
mesh-supergraph	24	779 total, 0 failed	avg: 3949ms, p95: 6414ms	✅

Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 17427      ✗ 0    
     data_received..................: 510 MB  17 MB/s
     data_sent......................: 6.9 MB  227 kB/s
     http_req_blocked...............: avg=120.31µs min=1.49µs  med=3.08µs   max=240.27ms p(90)=4.98µs   p(95)=5.99µs  
     http_req_connecting............: avg=91.27µs  min=0s      med=0s       max=240.21ms p(90)=0s       p(95)=0s      
     http_req_duration..............: avg=336.56ms min=10.57ms med=300.19ms max=2.19s    p(90)=575.59ms p(95)=708.62ms
       { expected_response:true }...: avg=336.56ms min=10.57ms med=300.19ms max=2.19s    p(90)=575.59ms p(95)=708.62ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 5809 
     http_req_receiving.............: avg=77.14ms  min=39.51µs med=84.71µs  max=2.04s    p(90)=324.15ms p(95)=457.99ms
     http_req_sending...............: avg=4.12ms   min=8.9µs   med=14.45µs  max=859.83ms p(90)=60.02µs  p(95)=2.21ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=255.3ms  min=10ms    med=240.02ms max=723.35ms p(90)=424.53ms p(95)=486.96ms
     http_reqs......................: 5809    191.483439/s
     iteration_duration.............: avg=519.76ms min=24.34ms med=464.85ms max=2.57s    p(90)=930.31ms p(95)=1.12s   
     iterations.....................: 5809    191.483439/s
     vus............................: 100     min=100      max=100
     vus_max........................: 100     min=100      max=100

Performance Overview

Subgraphs Overview

HTTP Overview

Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 15690      ✗ 0    
     data_received..................: 459 MB  15 MB/s
     data_sent......................: 6.2 MB  204 kB/s
     http_req_blocked...............: avg=45.61µs  min=1.46µs  med=2.91µs   max=41.9ms   p(90)=4.36µs   p(95)=5.45µs  
     http_req_connecting............: avg=26.71µs  min=0s      med=0s       max=4.07ms   p(90)=0s       p(95)=0s      
     http_req_duration..............: avg=488.65ms min=17.04ms med=482.49ms max=1.87s    p(90)=645.57ms p(95)=730.92ms
       { expected_response:true }...: avg=488.65ms min=17.04ms med=482.49ms max=1.87s    p(90)=645.57ms p(95)=730.92ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 5230 
     http_req_receiving.............: avg=36.32ms  min=34.98µs med=75.19µs  max=1.59s    p(90)=83.14ms  p(95)=255.63ms
     http_req_sending...............: avg=1.59ms   min=8.55µs  med=13.82µs  max=876.13ms p(90)=45.1µs   p(95)=163.15µs
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=450.72ms min=16.17ms med=466.95ms max=821.63ms p(90)=597.79ms p(95)=635.42ms
     http_reqs......................: 5230    171.713836/s
     iteration_duration.............: avg=578.17ms min=29.59ms med=537.9ms  max=2.53s    p(90)=816.2ms  p(95)=1.02s   
     iterations.....................: 5230    171.713836/s
     vus............................: 100     min=100      max=100
     vus_max........................: 100     min=100      max=100

Performance Overview

Subgraphs Overview

HTTP Overview

Summary for: `wundergraph`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 14046      ✗ 0    
     data_received..................: 411 MB  14 MB/s
     data_sent......................: 5.6 MB  183 kB/s
     http_req_blocked...............: avg=49µs     min=1.1µs   med=2.89µs   max=4.81ms p(90)=4.65µs   p(95)=5.91µs  
     http_req_connecting............: avg=42.68µs  min=0s      med=0s       max=4.78ms p(90)=0s       p(95)=0s      
     http_req_duration..............: avg=532.97ms min=20.74ms med=491.68ms max=2.5s   p(90)=884.23ms p(95)=1.02s   
       { expected_response:true }...: avg=532.97ms min=20.74ms med=491.68ms max=2.5s   p(90)=884.23ms p(95)=1.02s   
     http_req_failed................: 0.00%   ✓ 0          ✗ 4682 
     http_req_receiving.............: avg=57.63ms  min=35.02µs med=90.21µs  max=2.34s  p(90)=173.82ms p(95)=412.86ms
     http_req_sending...............: avg=3.36ms   min=7.32µs  med=13.43µs  max=1.93s  p(90)=47.41µs  p(95)=1.01ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s     p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=471.97ms min=17.04ms med=446.72ms max=1.26s  p(90)=800.61ms p(95)=917.82ms
     http_reqs......................: 4682    153.915087/s
     iteration_duration.............: avg=645.64ms min=34.13ms med=577.11ms max=3.19s  p(90)=1.07s    p(95)=1.3s    
     iterations.....................: 4682    153.915087/s
     vus............................: 100     min=100      max=100
     vus_max........................: 100     min=100      max=100

Performance Overview

Subgraphs Overview

HTTP Overview

Summary for: `mesh-supergraph-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 6228      ✗ 0    
     data_received..................: 182 MB  5.9 MB/s
     data_sent......................: 2.5 MB  80 kB/s
     http_req_blocked...............: avg=55.87µs  min=1.6µs    med=3.32µs   max=3.02ms   p(90)=5.52µs  p(95)=27.7µs  
     http_req_connecting............: avg=48.41µs  min=0s       med=0s       max=2.84ms   p(90)=0s      p(95)=0s      
     http_req_duration..............: avg=1.44s    min=666.4ms  med=1.24s    max=3.38s    p(90)=2.36s   p(95)=2.5s    
       { expected_response:true }...: avg=1.44s    min=666.4ms  med=1.24s    max=3.38s    p(90)=2.36s   p(95)=2.5s    
     http_req_failed................: 0.00%   ✓ 0         ✗ 2076 
     http_req_receiving.............: avg=15.11ms  min=40.9µs   med=148.41µs max=596.44ms p(90)=2.13ms  p(95)=52.48ms 
     http_req_sending...............: avg=289.49µs min=8.9µs    med=16.88µs  max=60.91ms  p(90)=46.23µs p(95)=263.81µs
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s      p(95)=0s      
     http_req_waiting...............: avg=1.42s    min=665.28ms med=1.23s    max=3.32s    p(90)=2.36s   p(95)=2.49s   
     http_reqs......................: 2076    67.292098/s
     iteration_duration.............: avg=1.46s    min=675.61ms med=1.26s    max=3.4s     p(90)=2.38s   p(95)=2.53s   
     iterations.....................: 2076    67.292098/s
     vus............................: 100     min=100     max=100
     vus_max........................: 100     min=100     max=100

Performance Overview

Subgraphs Overview

HTTP Overview

Summary for: `apollo-server`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 5109     ✗ 0    
     data_received..................: 150 MB  4.8 MB/s
     data_sent......................: 2.0 MB  65 kB/s
     http_req_blocked...............: avg=51.62µs  min=1.58µs   med=3.17µs   max=2.72ms  p(90)=5.07µs   p(95)=154.63µs
     http_req_connecting............: avg=43.05µs  min=0s       med=0s       max=2.26ms  p(90)=0s       p(95)=103.69µs
     http_req_duration..............: avg=1.79s    min=337.1ms  med=1.5s     max=19.58s  p(90)=1.82s    p(95)=2.32s   
       { expected_response:true }...: avg=1.79s    min=337.1ms  med=1.5s     max=19.58s  p(90)=1.82s    p(95)=2.32s   
     http_req_failed................: 0.00%   ✓ 0        ✗ 1703 
     http_req_receiving.............: avg=329.97µs min=41.32µs  med=121.15µs max=69.27ms p(90)=204.39µs p(95)=299.12µs
     http_req_sending...............: avg=55.11µs  min=8.65µs   med=16.69µs  max=6.52ms  p(90)=33.72µs  p(95)=100.3µs 
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s      p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=1.79s    min=336.93ms med=1.5s     max=19.58s  p(90)=1.82s    p(95)=2.32s   
     http_reqs......................: 1703    54.52862/s
     iteration_duration.............: avg=1.8s     min=344.07ms med=1.51s    max=19.59s  p(90)=1.84s    p(95)=2.33s   
     iterations.....................: 1703    54.52862/s
     vus............................: 36      min=36     max=100
     vus_max........................: 100     min=100    max=100

Performance Overview

Subgraphs Overview

HTTP Overview

Summary for: `mercurius`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 2799     ✗ 0    
     data_received..................: 82 MB   2.6 MB/s
     data_sent......................: 1.1 MB  36 kB/s
     http_req_blocked...............: avg=323.51µs min=1.43µs  med=3.64µs   max=6.77ms  p(90)=320.29µs p(95)=3.58ms  
     http_req_connecting............: avg=288.68µs min=0s      med=0s       max=6.63ms  p(90)=191.76µs p(95)=3.04ms  
     http_req_duration..............: avg=3.29s    min=1.06s   med=3.08s    max=7.05s   p(90)=4.08s    p(95)=4.28s   
       { expected_response:true }...: avg=3.29s    min=1.06s   med=3.08s    max=7.05s   p(90)=4.08s    p(95)=4.28s   
     http_req_failed................: 0.00%   ✓ 0        ✗ 933  
     http_req_receiving.............: avg=635.77µs min=40.08µs med=111.14µs max=67.12ms p(90)=202.26µs p(95)=411.05µs
     http_req_sending...............: avg=63.03µs  min=8.64µs  med=19.76µs  max=4.3ms   p(90)=58.64µs  p(95)=256.34µs
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s      p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=3.29s    min=1.06s   med=3.08s    max=7.05s   p(90)=4.08s    p(95)=4.27s   
     http_reqs......................: 933     29.89515/s
     iteration_duration.............: avg=3.31s    min=1.07s   med=3.1s     max=7.06s   p(90)=4.09s    p(95)=4.28s   
     iterations.....................: 933     29.89515/s
     vus............................: 33      min=33     max=100
     vus_max........................: 100     min=100    max=100

Performance Overview

Subgraphs Overview

HTTP Overview

Summary for: `mesh-supergraph`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 2337      ✗ 0    
     data_received..................: 68 MB   2.2 MB/s
     data_sent......................: 925 kB  29 kB/s
     http_req_blocked...............: avg=161.42µs min=1.56µs  med=4.12µs   max=7.68ms  p(90)=252.58µs p(95)=1.07ms  
     http_req_connecting............: avg=128.97µs min=0s      med=0s       max=3.92ms  p(90)=173.95µs p(95)=889.18µs
     http_req_duration..............: avg=3.94s    min=1.89s   med=3.69s    max=7.4s    p(90)=5.8s     p(95)=6.41s   
       { expected_response:true }...: avg=3.94s    min=1.89s   med=3.69s    max=7.4s    p(90)=5.8s     p(95)=6.41s   
     http_req_failed................: 0.00%   ✓ 0         ✗ 779  
     http_req_receiving.............: avg=2.53ms   min=45.56µs med=171.93µs max=86.04ms p(90)=2.99ms   p(95)=6.37ms  
     http_req_sending...............: avg=60.5µs   min=7.81µs  med=22.26µs  max=2.55ms  p(90)=104.84µs p(95)=325.06µs
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s      p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=3.94s    min=1.89s   med=3.69s    max=7.4s    p(90)=5.8s     p(95)=6.41s   
     http_reqs......................: 779     24.689409/s
     iteration_duration.............: avg=3.96s    min=1.9s    med=3.71s    max=7.41s   p(90)=5.82s    p(95)=6.43s   
     iterations.....................: 779     24.689409/s
     vus............................: 46      min=46      max=100
     vus_max........................: 100     min=100     max=100

Performance Overview

Subgraphs Overview

HTTP Overview

github-actions · 2024-10-02T13:13:18Z

Overview for: `federation-v1/ramping-vus`

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. We are running a heavy load of concurrent VUs to measure response time and other stats, during stress. It measure things like memory usage, CPU usage, response times. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was trying to reach 500 concurrent VUs over 60s

Comparison

Gateway	duration(p95)⬇️	RPS	Requests	Durations	Notes
cosmo	2250ms	182	12797 total, 0 failed	avg: 748ms, p95: 2251ms, max: 9271ms, med: 501ms	✅
wundergraph	2422ms	159	11175 total, 0 failed	avg: 865ms, p95: 2423ms, max: 7279ms, med: 675ms	✅
apollo-router	2847ms	168	11793 total, 0 failed	avg: 861ms, p95: 2848ms, max: 9163ms, med: 551ms	✅
mesh-supergraph-bun	7823ms	85	6013 total, 0 failed	avg: 3122ms, p95: 7824ms, max: 12433ms, med: 2861ms	✅
mesh-supergraph	8243ms	55	3904 total, 0 failed	avg: 4948ms, p95: 8244ms, max: 10212ms, med: 5166ms	✅
apollo-server	22308ms	71	5195 total, 0 failed	avg: 3994ms, p95: 22309ms, max: 44210ms, med: 2187ms	✅

Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 38391      ✗ 0    
     data_received..................: 1.1 GB  16 MB/s
     data_sent......................: 15 MB   217 kB/s
     http_req_blocked...............: avg=19.44ms  min=1.39µs  med=3.04µs   max=4.3s   p(90)=4.67µs   p(95)=17.21µs
     http_req_connecting............: avg=18.79ms  min=0s      med=0s       max=3.77s  p(90)=0s       p(95)=0s     
     http_req_duration..............: avg=748.49ms min=3.58ms  med=501.27ms max=9.27s  p(90)=1.76s    p(95)=2.25s  
       { expected_response:true }...: avg=748.49ms min=3.58ms  med=501.27ms max=9.27s  p(90)=1.76s    p(95)=2.25s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 12797
     http_req_receiving.............: avg=260.95ms min=33.97µs med=81.78µs  max=6.72s  p(90)=1.01s    p(95)=1.61s  
     http_req_sending...............: avg=30.08ms  min=8.14µs  med=13.96µs  max=3.27s  p(90)=319.38µs p(95)=76.24ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s     p(90)=0s       p(95)=0s     
     http_req_waiting...............: avg=457.45ms min=3.48ms  med=302.55ms max=3.28s  p(90)=1.05s    p(95)=1.27s  
     http_reqs......................: 12797   182.790768/s
     iteration_duration.............: avg=1.43s    min=9.03ms  med=970.93ms max=11.48s p(90)=3.4s     p(95)=4.32s  
     iterations.....................: 12797   182.790768/s
     vus............................: 1       min=1        max=499
     vus_max........................: 500     min=500      max=500

Performance Overview

Subgraphs Overview

HTTP Overview

Summary for: `wundergraph`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 33525     ✗ 0    
     data_received..................: 981 MB  14 MB/s
     data_sent......................: 13 MB   190 kB/s
     http_req_blocked...............: avg=31.17ms  min=1.45µs  med=3.17µs   max=3.82s p(90)=5.14µs p(95)=36µs    
     http_req_connecting............: avg=29.94ms  min=0s      med=0s       max=3.82s p(90)=0s     p(95)=0s      
     http_req_duration..............: avg=865.37ms min=6.08ms  med=675.1ms  max=7.27s p(90)=1.9s   p(95)=2.42s   
       { expected_response:true }...: avg=865.37ms min=6.08ms  med=675.1ms  max=7.27s p(90)=1.9s   p(95)=2.42s   
     http_req_failed................: 0.00%   ✓ 0         ✗ 11175
     http_req_receiving.............: avg=251.56ms min=32.98µs med=83.64µs  max=6.74s p(90)=1.04s  p(95)=1.47s   
     http_req_sending...............: avg=36.25ms  min=8.08µs  med=14.95µs  max=4.58s p(90)=2.57ms p(95)=133.98ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s    p(90)=0s     p(95)=0s      
     http_req_waiting...............: avg=577.56ms min=6.01ms  med=475.46ms max=3.2s  p(90)=1.19s  p(95)=1.45s   
     http_reqs......................: 11175   159.61647/s
     iteration_duration.............: avg=1.64s    min=11.49ms med=1.24s    max=10.1s p(90)=3.66s  p(95)=4.61s   
     iterations.....................: 11175   159.61647/s
     vus............................: 1       min=1       max=500
     vus_max........................: 500     min=500     max=500

Performance Overview

Subgraphs Overview

HTTP Overview

Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 35379      ✗ 0    
     data_received..................: 1.0 GB  15 MB/s
     data_sent......................: 14 MB   200 kB/s
     http_req_blocked...............: avg=18.79ms  min=1.55µs  med=3.08µs   max=4.19s  p(90)=4.94µs   p(95)=21.95µs
     http_req_connecting............: avg=17.62ms  min=0s      med=0s       max=3.47s  p(90)=0s       p(95)=0s     
     http_req_duration..............: avg=860.57ms min=6.21ms  med=550.68ms max=9.16s  p(90)=2.14s    p(95)=2.84s  
       { expected_response:true }...: avg=860.57ms min=6.21ms  med=550.68ms max=9.16s  p(90)=2.14s    p(95)=2.84s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 11793
     http_req_receiving.............: avg=347.44ms min=32.44µs med=79.45µs  max=7.26s  p(90)=1.42s    p(95)=2.14s  
     http_req_sending...............: avg=39.55ms  min=8.41µs  med=14.47µs  max=4.64s  p(90)=371.1µs  p(95)=73.63ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s     p(90)=0s       p(95)=0s     
     http_req_waiting...............: avg=473.58ms min=6.13ms  med=372.53ms max=2.87s  p(90)=986.87ms p(95)=1.19s  
     http_reqs......................: 11793   168.461512/s
     iteration_duration.............: avg=1.57s    min=11.8ms  med=986.93ms max=12.48s p(90)=3.9s     p(95)=4.89s  
     iterations.....................: 11793   168.461512/s
     vus............................: 1       min=1        max=499
     vus_max........................: 500     min=500      max=500

Performance Overview

Subgraphs Overview

HTTP Overview

Summary for: `mesh-supergraph-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 18039     ✗ 0    
     data_received..................: 528 MB  7.5 MB/s
     data_sent......................: 7.1 MB  102 kB/s
     http_req_blocked...............: avg=1.61ms  min=1.61µs  med=3.18µs  max=423.01ms p(90)=11µs     p(95)=251.08µs
     http_req_connecting............: avg=1.51ms  min=0s      med=0s      max=316.22ms p(90)=0s       p(95)=165.42µs
     http_req_duration..............: avg=3.12s   min=10.85ms med=2.86s   max=12.43s   p(90)=5.24s    p(95)=7.82s   
       { expected_response:true }...: avg=3.12s   min=10.85ms med=2.86s   max=12.43s   p(90)=5.24s    p(95)=7.82s   
     http_req_failed................: 0.00%   ✓ 0         ✗ 6013 
     http_req_receiving.............: avg=26.55ms min=37.65µs med=80.29µs max=1.82s    p(90)=3.03ms   p(95)=152.89ms
     http_req_sending...............: avg=2.59ms  min=7.93µs  med=15.03µs max=449.79ms p(90)=100.91µs p(95)=9.6ms   
     http_req_tls_handshaking.......: avg=0s      min=0s      med=0s      max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=3.09s   min=10.71ms med=2.85s   max=12.43s   p(90)=5.07s    p(95)=7.82s   
     http_reqs......................: 6013    85.886641/s
     iteration_duration.............: avg=3.18s   min=16.94ms med=2.91s   max=12.67s   p(90)=5.27s    p(95)=7.9s    
     iterations.....................: 6013    85.886641/s
     vus............................: 1       min=1       max=500
     vus_max........................: 500     min=500     max=500

Performance Overview

Subgraphs Overview

HTTP Overview

Summary for: `mesh-supergraph`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 11712     ✗ 0    
     data_received..................: 343 MB  4.9 MB/s
     data_sent......................: 4.6 MB  66 kB/s
     http_req_blocked...............: avg=390.08µs min=1.71µs  med=4.39µs   max=145.52ms p(90)=208.06µs p(95)=471.06µs
     http_req_connecting............: avg=360.74µs min=0s      med=0s       max=145.44ms p(90)=145.61µs p(95)=384.48µs
     http_req_duration..............: avg=4.94s    min=12.8ms  med=5.16s    max=10.21s   p(90)=7.72s    p(95)=8.24s   
       { expected_response:true }...: avg=4.94s    min=12.8ms  med=5.16s    max=10.21s   p(90)=7.72s    p(95)=8.24s   
     http_req_failed................: 0.00%   ✓ 0         ✗ 3904 
     http_req_receiving.............: avg=1.95ms   min=40.2µs  med=124.64µs max=253.47ms p(90)=2.39ms   p(95)=5.18ms  
     http_req_sending...............: avg=343.35µs min=8.45µs  med=25.23µs  max=90.69ms  p(90)=57.57µs  p(95)=106.43µs
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=4.94s    min=12.71ms med=5.16s    max=10.21s   p(90)=7.71s    p(95)=8.24s   
     http_reqs......................: 3904    55.769571/s
     iteration_duration.............: avg=4.98s    min=18.65ms med=5.19s    max=10.24s   p(90)=7.74s    p(95)=8.28s   
     iterations.....................: 3904    55.769571/s
     vus............................: 1       min=1       max=499
     vus_max........................: 500     min=500     max=500

Performance Overview

Subgraphs Overview

HTTP Overview

Summary for: `apollo-server`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 15585     ✗ 0    
     data_received..................: 457 MB  6.3 MB/s
     data_sent......................: 6.2 MB  85 kB/s
     http_req_blocked...............: avg=110.98µs min=1.42µs  med=3.39µs   max=51.7ms   p(90)=19.11µs  p(95)=251.15µs
     http_req_connecting............: avg=100.24µs min=0s      med=0s       max=51.63ms  p(90)=0s       p(95)=175.87µs
     http_req_duration..............: avg=3.99s    min=72.06ms med=2.18s    max=44.2s    p(90)=3.37s    p(95)=22.3s   
       { expected_response:true }...: avg=3.99s    min=72.06ms med=2.18s    max=44.2s    p(90)=3.37s    p(95)=22.3s   
     http_req_failed................: 0.00%   ✓ 0         ✗ 5195 
     http_req_receiving.............: avg=333.61µs min=45.87µs med=112.78µs max=138.38ms p(90)=213.35µs p(95)=332.34µs
     http_req_sending...............: avg=72.87µs  min=8.84µs  med=18.07µs  max=30.21ms  p(90)=42.83µs  p(95)=62.09µs 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=3.99s    min=71.94ms med=2.18s    max=44.2s    p(90)=3.37s    p(95)=22.3s   
     http_reqs......................: 5195    71.267016/s
     iteration_duration.............: avg=4s       min=84.01ms med=2.19s    max=44.21s   p(90)=3.38s    p(95)=22.32s  
     iterations.....................: 5195    71.267016/s
     vus............................: 70      min=57      max=500
     vus_max........................: 500     min=500     max=500

Performance Overview

Subgraphs Overview

HTTP Overview

renovate bot force-pushed the renovate/tablemark-3.x branch from 4d3e49d to 3f5aa4c Compare October 2, 2024 13:01

renovate bot force-pushed the renovate/tablemark-3.x branch 7 times, most recently from 7b76d77 to d2339ed Compare October 2, 2024 21:31

Update dependency tablemark to v3.1.0

3ccccc8

renovate bot force-pushed the renovate/tablemark-3.x branch from d2339ed to 3ccccc8 Compare October 3, 2024 01:51

renovate bot merged commit fef2699 into main Oct 3, 2024
33 checks passed

renovate bot deleted the renovate/tablemark-3.x branch October 3, 2024 03:05

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Update dependency tablemark to v3.1.0 #439

Update dependency tablemark to v3.1.0 #439

Uh oh!

renovate bot commented Apr 8, 2024 •

edited

Loading

Uh oh!

github-actions bot commented Oct 2, 2024 •

edited

Loading

Uh oh!

github-actions bot commented Oct 2, 2024 •

edited

Loading

Uh oh!

github-actions bot commented Oct 2, 2024 •

edited

Loading

Uh oh!

github-actions bot commented Oct 2, 2024 •

edited

Loading

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

0 participants

Update dependency tablemark to v3.1.0 #439

Update dependency tablemark to v3.1.0 #439

Uh oh!

Conversation

renovate bot commented Apr 8, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Release Notes

v3.1.0

FEATURES

Configuration

Uh oh!

github-actions bot commented Oct 2, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Overview for: federation-v1/constant-vus-over-time

Comparison

Uh oh!

github-actions bot commented Oct 2, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Overview for: federation-v1/constant-vus-subgraphs-delay-resources

Comparison

Uh oh!

github-actions bot commented Oct 2, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Overview for: federation-v1/constant-vus-subgraphs-delay

Comparison

Uh oh!

github-actions bot commented Oct 2, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Overview for: federation-v1/ramping-vus

Comparison

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

0 participants

renovate bot commented Apr 8, 2024 •

edited

Loading

`v3.1.0`

github-actions bot commented Oct 2, 2024 •

edited

Loading

Overview for: `federation-v1/constant-vus-over-time`

github-actions bot commented Oct 2, 2024 •

edited

Loading

Overview for: `federation-v1/constant-vus-subgraphs-delay-resources`

github-actions bot commented Oct 2, 2024 •

edited

Loading

Overview for: `federation-v1/constant-vus-subgraphs-delay`

github-actions bot commented Oct 2, 2024 •

edited

Loading

Overview for: `federation-v1/ramping-vus`